LATCH STRUCTURE FOR INTERLOCKED 



PIPELINED CMOS (IPCMOS) CIRCUITS 

CROSS REFERENCE TO RELATED APPLICATION 

This application claims priority to Provisional 
Application Serial No. 60/212,000 filed June 16, 2000. 
Provisional Application Serial No. 60/212,000 is 
incorporated herein by reference. 

BACKGROUND OF THE INVENTION 
1 • Field of the Invention 

The present invention relates to data transfer, and 
more particularly to a system and method for transferring 
data through latches which reduces the number of latches, 
reduces power consumption and enables the latches to receive 
or transmit data only when an operation is to be performed. 

2 . Description of the Related Art 

Interlocked pipelined complementary metal oxide 
semiconductor (IPCMOS) circuits and techniques are disclosed 
in U.S. Patent No. 6,182,233, incorporated herein by 
reference. A paper describing the results of an 
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implementation of these IPCMOS circuits on a test site is 
found in an article published in the ISSCC 2000 Digest of 
Technical Papers, Session 17, Logic and Systems, Paper WA 
17,3, by Schuster et al . entitled "Asynchronous Interlocked 
Pipelined CMOS Circuits at 3.3-4.5 GHz", incorporated herein 
by reference and hereinafter referred to as the ISSCC paper. 
In the ISSCC paper, asynchronous interlocked locally 
generated clocks drive a path through a 3 to 2 compressor 
tree of a Floating Point Multiplier (FPM) at frequencies as 
fast as 4.5 GHz in a 0.18 micron 1.5 Volt bulk CMOS 
technology. Power reductions greater than two times are 
estimated with these IPCMOS techniques. 

In U.S. Patent Application No. 6,182,233 referenced 
above, circuits and techniques are disclosed for 
asynchronously interlocking blocks in the forward and 
reverse directions that have extremely small overhead for 
handshaking. This makes very high performance possible. 

Interlocked Pipelined CMOS circuits and techniques are 
also disclosed in commonly assigned U.S. Application No. 
09/746,647 to Cook et al . , filed on December 21, 2000 and 
entitled "Asynchronous Pipeline Control Interface, " 
(hereinafter referred to as Cook et al.) . Cook et al . is 
incorporated herein by reference. Cook et al . includes 
circuits and techniques for asynchronously interlocking 
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blocks in the forward and reverse directions that have 
extremely small overhead for the handshaking. This makes 
very high performance possible. 

In conventional synchronous approaches a global clock 
activates all the latches simultaneously. Synchronous 
pipelines are typically subject to clock skew problems which 
may cause undesirable delays in the pipelines. 

Referring to FIG. 1A, a master/slave latch 10 is 
employed to prevent data from logic stage 11 from 
propagating through latch 10 before a logic stage 12 is 
ready to act on the data. Master/slave latch 10 includes a 
master latch 18 and a slave latch 20. Master latch 18 
empties data into slave latch 18 in accordance with global 
clock signals. Switches 14 and 16 of latch 10 are enabled by 
global clock pulses CI and C2, respectively, to transfer 
data (Data) across latch 10 as shown in FIG. IB which shows 
a timing diagram. Unfortunately, the master slave approach 
has to deal with clock skew and jitter and consumes more 
power in the clocking to drive both the master and the slave 
latches . 

Referring to FIG. 2A, another approach is to split a 
logic stage into portions 22 (preferably split in half in 
accordance with delay (i.e., one half the delay for each 
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portion 22)) and place a latch 24 and a latch 26 such that 
latches 24 and 26 are split between the logic stages 22. 
Switches 14 and 16 of latches 24 and 26 are enabled by 
global clock pulses CI and C2 , respectively, to transfer 
data (Data (a and Data(b)) across the latches as shown in 
FIG. 2B which shows a timing diagram. This reduces the 
problem of dealing with clock skew and jitter, but since the 
number of latches is the same as in the master slave 
approach of FIG. 1A, the clock power is not reduced. In 
fact, there will be additional power consumed by this 
approach since inputs which are connected to the logic 22 
receive data before the logic stages 22 attain their final 
values. This will result in a higher logic switching 
factor. In addition, both the approaches of FIGS. 1A and 2A 
consume power whether or not there is an operation to 
perform as a result of the continuously running synchronous 
(global) clock. 

Therefore, a need exists for latch circuits and methods 
of operating the latch circuits which reduce the number of 
latches and/or clock loading, consume power only when there 
is an operation to perform and achieve higher speed compared 
to existing approaches. 
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SUMMARY OF THE INVENTION 

Circuits and methods for operating a latch structure 
are disclosed. The circuits include a plurality of stages, 
and each stage includes a first logic circuit, a latch 
coupled to a second logic circuit of an adjacent stage and a 
switch which connects the first logic circuit to the latch 
in a first state and disconnects the logic circuit from the 
latch in a second state. A local clock circuit controls the 
first and second states by providing a locally generated 
clock signal to activate the switch. The locally generated 
clock signals are generated by interlocking handshake 
signals from a local clock circuit of an adjacent stage. 

A method for transferring data in an interlocked 
pipeline circuit having a plurality of stages includes 
providing, for each stage, a latch connected to an input of 
that stage and a switch for selectively coupling the input 
of the stage to an output of the previous stage. When the 
data is valid in a current stage, a valid signal is sent to 
a local clock circuit of a next stage of the plurality of 
stages. An acknowledge signal is sent from the local clock 
circuit of the next stage to a local clock circuit of the 
current stage responsive to the valid signal. A local clock 
signal is generated at the local clock circuit of the 
current stage of the plurality of stages based on the 
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acknowledge signal and the valid signal. The switch of the 
current stage is enabled based on the local clock signal to 
permit data transfer to the latch of the current stage from 
the output of the previous stage . 

These and other objects, features and advantages of the 
present invention will become apparent from the following 
detailed description of illustrative embodiments thereof, 
which is to be read in connection with the accompanying 
drawings . 

BRIEF DESCRIPTION OF DRAWINGS 

The invention will be described in detail in the 
following description of preferred embodiments with 
reference to the following figures wherein: 

FIG. 1A is a schematic diagram of a conventional 
master/slave latch; 

FIG. IB is a timing diagram for demonstrating operation 
of the conventional master/slave latch of FIG. 1A; 

FIG. 2A is a schematic diagram of a conventional 
transparent latch circuit interposed between logic circuits 
split in accordance with delay; 

FIG. 2B is a timing diagram for demonstrating operation 
of the conventional transparent latch of FIG. 2A; 
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FIG. 3A is a schematic diagram of a interlocked 
pipeline latch in accordance with the present invention; 

FIG. 3B is a timing diagram for demonstrating operation 
of the latch of FIG, 3A in accordance with the present 
invention; 

FIG. 4 is a plot of relative power versus switching 
factor which compares the prior art with the present 
invention; 

FIG. 5 is a schematic diagram of a stage in a pipeline 
employing the latch structure of the present invention and 
further employing a scan chain in accordance with an 
embodiment of the present invention; 

FIG. 6 is a schematic diagram of multiple stages in a 
pipeline showing interlocking connections between the stages 
in accordance with the present invention; 

FIG. 7 is a schematic block diagram showing 
interlocking connections in forward and reverse directions 
between stages of a pipeline in accordance with the present 
invention; 

FIG. 8 is a schematic diagram of two latch stages in a 
pipeline of a multiplier employing the latch structure and 
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local clock circuits m accordance with the present 
invention; 

FIG. 9A is a schematic diagram of a local clock circuit 
in accordance with one embodiment of the present invention; 

FIG. 9B is a schematic diagram of a switch employed in 
the local clock circuit of FIG. 9A in accordance with one 
embodiment of the present invention; 

FIG. 10 is an illustrative timing diagram showing how 
the local clock circuit of FIG. 9A performs an AND function 
on a plurality of valid signals in accordance with the 
present invention; and 

FIG. 11 is a plot of measured waveforms for local clock 
signals in accordance with the present invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

The present invention provides a latch structure which 
employs a locally generated clock. The latch structure 
includes latches which are enabled by the locally generated 
clock to permit data transfer from one latch stage while 
adjacent latch stages are prevented from transferring data. 
The latch structure is nearly immune from clock skew and 
jitter and significantly reduces power consumption. 
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In Cook et al . , cited above, a method for embedding a 
latch in a dynamic logic stage was disclosed. This 
combination of logic and latch works well for dynamic 
circuits. For static circuits, the combination of a look 
5 aside or parallel latch as shown in FIGS . 1A and 2A can be 
combined with a locally generated interlocked clock in 
accordance with the present invention. 

It should be understood that the elements shown in the 
FIGS, may be implemented in various forms of hardware, 

10 software or combinations thereof. Preferably, these elements 
are implemented in hardware on one or more appropriately 
programmed general purpose integrated circuits which may 
include a processor, memory and input/output interfaces. 
Referring now to the drawings in which like numerals 

15 represent the same or similar elements and initially to FIG. 
3A, a simplified pipeline structure 100 is shown in 
accordance with one embodiment of the present invention. 
Latch structure 100 includes full logic stages 102 (as 
opposed to the half logic stages of FIG. 2A) . A latch 104 

20 and a latch 106 are separated by one full logic stage 102. 

Switches 108 and 110 of latches 104 and 106 are enabled by 
locally generated clock signals CLKEi and CLKEj , 
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respectively, to transfer data (Data(i) and Data(j)) across 
the latches as shown in FIG. 3B which shows a timing 
diagram. 

Although latches 104 and 106 and logic stages 102 of 
5 FIG. 3A look similar to the latches and logic of FIG. 2A, 

the number of latches differ by a factor of two times since 
full logic stages 102 can advantageously be employed. This 
is because the interlocking of stages (described below) 
produces local clocks (CLKE) which are only enabled when the 

10 data for that stage is valid and corresponding local clocks 
on immediately adjacent stages are not enabled. In other 
words, the interlocking handshake signals provide operations 
such that when one stage is enabled immediately adjacent 
stages are disabled for data transfer in a current clock 

15 cycle. This eliminates the possibility of signals 

propagating through multiple latches in a single clock 
cycle. Therefore, in this example, half the number of latch 
stages are needed while still maintaining safe operation. 
The reduced number of latch stages combined with enabling 

20 the local clocks only when there is an operation to perform 
results in significant power reduction. 
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Referring to FIG. 4, a plot of power versus switching 
factor comparing a prior art "Synchronous" latch structure 
(e.g., FIG. 1A or FIG. 2A) to an interlocked pipelined CMOS 
(IPCMOS) latch structure in accordance with the present 
5 invention. The plot includes the power for the master/slave 
approach (FIG. 1A) or transparent latch approach (FIG. 2A) 
versus the IPCMOS approach of the present invention as a 
function of macro switching factor, under the assumption 
% that 70% of the power is in the clocks and latches. Power 

rt 10 from input transitions after the clock is activated are not 
fl considered in any of the cases. Switching factors for most 

s 2 macros normally range from 10% to 3 0%. Surprisingly, by 

implementing the locally generated clock and latch structure 

s=si 

J of the present invention, power reductions of 5 times to 

15 more than 10 times can be realized. 

Referring to FIG. 5, a schematic of a latch structure 
including scan chains is shown in accordance with one 
embodiment of the present invention. FIG. 5 illustrates 
latch operation in accordance with the present invention. 
20 During normal operation, data is captured by a latch 2 04 

when a local clock CLKE (CLKEi in this case) for that stage 
is enabled. CLKE is generated when an acknowledge signal 
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(ACKj) is received from a local clock circuit 230' of a 
succeeding adjacent pipeline stage, and VALIDh is received 
from a preceding pipeline stage h (not shown) . CLKEi turns 
on pass gate switch 212 at the input to a pipeline stage 
213 . 

During testing, the enable clocks CLKE are turned off 
and clock signals CLKA and CLKB are used to scan data into 
or out of latches 204 (and 204') in the pipeline stages. 
When CLKA is enabled, turning on switch 218, data is 
transferred to latch 222. Next, CLKA is turned off and CLKB 
is enabled, turning on switch 220. This results in the data 
from latch 222 being transferred to latch 204'. Although 
only one pipeline stage is shown, one skilled in the art 
would understand that multiple stages could be 
interconnected and that data could either be scanned into 
the latch associated with each stage from an external pin or 
data from the latches associated with each stage could be 
scanned out to an external pin. 

In a normal mode of operation, CLKA and CLKB and their 
switches 218 and 22 0 are off (not conducting) and data moves 
from one latch stage 2 04 to the next (latch 2 04') as the 
local CLKE clocks are enabled. CLKA and CLKB are externally 
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activated clocks which may be activated during testing. A 
local clock circuit 230 sends a VALID signal (VALIDi) to 
indicate that valid data was received from a pipeline stage 
upstream from stage 213. Local clock circuit 230 r sends an 
acknowledge signal (ACKj ) indicating that the VALID signal 
was received. Clock pulse CLKEi is generated locally for 
stage 213. CLKEi enables data to be transferred to latch 
204 and through static logic 102. Data output from static 
logic 102 awaits the next clock cycle to be locally 
generated by local clock 230' to enable the data to be 
transferred to a downstream latch stage 204 In this way, 
one stage is enabled at a time ensuring that data does not 
move to more than one stage in a single clock cycle. As 
described above, this reduces the number of latches needed 
to safely transfer data by at least half the number of 
latches needed for prior art approaches . 

The interlocking connections which employ VALID and ACK 
signals are one important feature of the present invention. 
The interlocking signals guarantee that switches of adjacent 
stages to the stage performing the operation are not turned 
on at the same time as the switches of the current stage. 
This prevents data from propagating through more than one 



YOR9-2000-0402US1 (8728-497) -13- 



latch when the local clock to a stage is activated. During 
the time the switch is closed, data simply passes from the 
input side of the switch to the output side launching data 
to the next logic stage. The parallel or look aside latch 
holds the information until the switch is closed again and 
new data is brought in. 

Referring to FIG. 6, a multiple stage pipeline 300 is 
shown in accordance with one embodiment of the present 
invention. Pipeline 300 is an asynchronous pipeline. 
Stages 301, 302 an<3 303 each include a latch stage 304 for 
temporary storage of data which passes from stage to stage 
through pipeline 300. Latch stages 304a, 304b and 304c are 
interposed between logic circuits 306 for each stage. Latch 
stages 3 04a, 3 04b and 3 04c are each enabled by a separate 
locally generated clock signal (CLKEi, CLKEj and CLKEk, 
respectively) . 

When CLKEi is enabled, latch 3 04a simultaneously 
captures that data that is at its input and launches this 
data into logic 306. In addition, CLKEi launches the valid 
signal VALIDi which goes to interlock block 3 3 0b. Interlock 
block 3 3 0b is activated causing CLKEj to be enabled when 
both VALIDi and ACKk have occurred. When CLKEj is enabled, 
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latch 3 04b simultaneously captures the data at its input 
from the output of logic 306 in stage 301 and launches that 
data into logic 306 of stage 302. In addition, CLKEj 
launches the valid signal VALIDj which goes to interlock 
block 330b in stage 303. The process is continued for each 
stage in the pipeline 300. Local clock circuits 330a, 330b 
and 33 0c are employed for generating and receiving 
handshaking interlock signals, VALID and ACK. 

Referring to FIG. 7, a block diagram showing 
interlocking at the block level in the forward and reverse 
directions is illustratively shown. Block D is interlocked 
with all of blocks A, B, C , E and F with which block D 
interacts. In the forward direction, dedicated VALID 
signals emulate the worst case path through each driving 
block and thus determine when data can be latched within 
block D. In the reverse direction, Acknowledge (ACK) signals 
indicate that data has been received by the subsequent 
blocks and that new data may be processed within block D. 
In this interlocked approach local clocks are generated only 
when there is an operation to perform. 

Measured results on an experimental chip demonstrate 
robust operation for IPCMOS at 3.3GHz under typical 
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conditions and 4 . 5GHz under best case conditions in a 0.18 
micron 1.5V CMOS technology. The block diagram of FIG. 8 
illustratively shows the circuit implemented. Logic 402 
between latches 404 and 406 includes two stages of a worst 
case path through the 3 to 2 compressor tree of a 64b 
floating point multiplier with a total of ten of these 
stages included in the path. In this example, the 
asynchronous handshaking local clock circuits 408 were each 
loaded with 40 latches to simulate practical loading. Since 
the locally generated clocks for each stage (e.g., CLKEj and 
CLKEk) are active only when the data to a given stage is 
valid, power is conserved when the logic blocks are 
inactive. Furthermore, with the simplified clock 
environment, it is possible to design a very simple single 
stage latch that can capture and launch data simultaneously 
without the danger of a race. 

IPCMOS achieves high speed interlocking, in one 
embodiment by combining the function of a static NOR and an 
input switch to perform a unique cycle dependent AND 
function as exemplified by a local clock circuit or a strobe 
circuit 500 shown in FIGS. 9A and 9B. Every local clock 
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circuit 408 in FIG. 8 includes a strobe circuit 500 which 
implements asynchronous interlocking between stages. 

Referring to FIGS. 9A and 9B, a strobe or local clock 
circuit 500 is shown in accordance with an illustrative 
5 embodiment of the present invention. Invertors 501, n- 

channel devices 503, latches 504 and p-channel devices 505 
may be connected, replaced or otherwise altered as known by 
one skilled in the art. The operation of strobe circuit 500 
y can be understood by starting at the end of a cycle when 

f 4 . 10 external valid signals (VALID1 to VALIDi) and CLKR which is 
f\ generated from the acknowledge signals (ACK) are low, 

switches 502 are open, and the internal valid signals (Vintl 
L to Vinti) and Rint are high. The strobe outputs, CLKE and 

J ACK, which are high and low respectively, will transition to 

;P J 15 low and high respectively only when all of the internal 

valid signals (Vintl to Vinti) and Rint go low. For this to 
happen, each external valid signal (VALIDI to VALIDi) is 
first reset high, thereby turning on its associated switch 
502. Next, each of the valid inputs (VALIDI to VALIDi) will 
20 transition low, as data for that input becomes valid. This 
causes the associated internal valid signal (Vintl to Vinti) 
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to also go low. CLKEN is the falling clock signal having 
opposite polarity of CLKE. 

The strobe circuit 500 outputs, ACK and CLKE will both 
transition high and CLKEN will transition low, when the last 
of the external valid signals (VALID1 to VALIDi ) makes its 
downward transition and CLKR has gone high. When this 
occurs all the internal valid signals (Vintl to Vinti) and 
Rint will be low. ACK transitioning high turns each switch 
(502) off, since all the external valid signals (VALIDI to 
VALIDi) are low at this time. 

ACK is also the handshaking signal to stages or blocks 
transmitting data. The ACK signal represents that data has 
been received and the blocks can send more data. 
Immediately after ACK turns switch 502 off, CLKEN will 
precharge each of the internal valid nodes (Vint) and Rint 
high. This in turn will cause ACK and CLKE to go low and 
CLKEN to go high. In the strobe circuit 50 0 of FIG. 9A r a 
p-channel load device 505 of a static NOR 506 is connected 
to only one internal Valid signal (Vinti) . The Valid signal 
to which the load is connected should be the nominally last 
arriving. However, in actual operation if another signal 
arrives last the circuit will function normally but with 
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some additional power dissipation. A node X is labeled in 
FIGS. 9A and 9B to provide a reference between the FIGS. 

Referring to FIG. 10, the way strobe circuit 500 AMDs 
the valid inputs and at the same time keeps track of the 
5 cycle in which the inputs occur is seen in the wave forms of 
FIG, 10 for a circuit with three valid signals. Initially, 
all the external valid signals (VALID 1, VALID 2 and VALID 
3) are high. They all transition low and the strobe circuit 
l % generates a low CLKEN pulse output. Subsequently, a strobe 

fi 10 output is generated only after all 3 valid inputs have 
fl transitioned low to high to low. Thus the strobe circuit 

^ keeps track of the cycle each input occurs by not generating 

L an output until all the inputs have transitioned from a low 

^ to a high and back to a low. Y's (for yes) are indicated at 

r*? 15 positions where the local clock enables data transfer (where 
all signals are low in this case). N's (for no) are 
indicated at positions where one or more of the signals are 
high. Other circuits and transitioning methods may also be 
employed. 

20 Referring to FIG. 11, measured local clock signals 

(CLKEN 1-6) running at 4 . 5GHz are shown in the picoprobe 
wave forms for a testing operation. The way the 
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interlocking automatically compensates for delay variations, 
which can result from power supply noise, across chip line 
width variations, and parameter variations, is also seen in 
the wave forms when the data valid input of local clock 
stage 2 (CLKEN 2) is intentionally delayed for a period of 
time by the externally generated Valid Inhibit signal going 
high. Because of the handshaking, the local clocks for all 
the stages before and after stage 2 will also be delayed as 
shown in the wave forms, until Valid Inhibit goes low again 
and all the stages resume their normal mode of operation 
with no loss of data. 

A significant power reduction results when there is no 
operation to perform and the local clocks turn off. This is 
similar to what happened in the wave forms of FIG. 10 when 
the data valid signal of clock stage 2 was intentionally 
inhibited. The wave forms also show that the clock 
transitions are staggered in time, reducing the peak change 
in current with respect to time (di/dt) and therefore 
reducing noise compared to a conventional approach with a 
single global clock. 

Having described preferred embodiments of latch 
structure for interlocked pipelined CMOS (IPCMOS) circuits 
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(which are intended to be illustrative and not limiting) , it 
is noted that modifications and variations can be made by 
persons skilled in the art in light of the above teachings. 
It is therefore to be understood that changes may be made in 
the particular embodiments of the invention disclosed which 
are within the scope and spirit of the invention as outlined 
by the appended claims. Having thus described the invention 
with the details and particularity required by the patent 
laws, what is claimed and desired protected by Letters 
Patent is set forth in the appended claims. 
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